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In this paper, we study the rate of convergence of the cychc projection algorithm ap- 
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1 Introduction 

A very common problem in diverse areas of mathematics and engineering consists of trying 
to find a point in the intersection of closed convex sets Cj, i = 1, . . . ,m. This problem is 
often referred to as the convex feasibility problem. One popular method for solving the 
convex feasibility problem is the so-called cyclic projection algorithm. Mathematically, the 
cyclic projection algorithm is formulated as follows. Given finite many closed convex sets 
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Ci, C2, • • • , C„^ in M" with fl™ i Ci ^ 0. Let xq G M" and Pj := P^, « = 1, 2, • • • , "i, where 
PCi denotes the Euchdean projection to the set Ci. The sequence of cyclic projections, 
{xk)ken, is defined by 

(1.1) Xi := PlXo,X2 ■■= P2Xl,--- ,Xm ■= PmXm-l,Xm+l ■= PlXm ■ ■ ■ 

Bregman showed that the sequence {xk)k£N generated by the cyclic projection algorithm, 
converges to a point in C (see [I^ and [11 [5]). When m = 2, the cychc projection method 
reduces to the well known von Neumann alternating projection method (APM) (see |44j 
and also [6|.l8tll01lllj). The cyclic projection method has attracted many interests recently 
due to its simplicity and numerous applications to diverse areas such as engineering and 
the physical sciences, see [181 [261 la 13 [H El El El H [231 [2l] and the references therein. 

In this paper, we focus on the case where each set Ci is a scTni- algebraic convex set in 
the sense that there exist 7j G N and convex polynomial functions, gij,j = 1, . . . ,7j such 
that 

Q = {x G M" I gij{x) < 0, i = 1, • • • , 7i}. 

We then provide an explicit rate for the cyclic projection algorithm involving finitely 
many semi- algebraic convex sets without any regularity conditions. More precisely, let 
Ci be semi- algebraic convex sets generated by polynomials in M" with degree at most 



d, d G N\{1}. We show that the sequence of cyclic projections {xk)ken (1-1) converges 



(at least) at the rate of i-^, where p := ? t- and B(s) denotes the 

^ ^ kP' ^ mm{(2d-l)"-l,2/3(n-l)d"-2} ^ ^ 

central binomial coefficient with respect to s which is given by (r^rti)- P 

The remainder of this paper is organized as follows. In Section [2| we collect notations 
and auxiliary results for future reference and for the reader's convenience. In Section[3| we 
give a Holderian regularity result for finitely many semi-algebraic convex sets. The proof 
of our main result (Theorem 4.2) forms the bulk of Section El In Section ml we explore 



various concrete examples. Finally, we end the paper with some conclusions and open 
questions. 



2 Preliminaries and auxiliary results 

We assume throughout that M" is a Euclidean space with the norm || • || and the inner 
product (•, •), where n G N := {1, 2, 3, • • • }. We reserve d G N. We denote by M{x, e) := 
{y G M"^ I \\y — x\\ < e}. We adopt standard notation used in these books (TUl HH [ISl 1201 

iniiaiis]. 

Given a subset C of M", intC is the interior of C, bdC is the boundary of C, aSC 
is the affine hull of C and C is the norm closure of C. We set C"*" := {x* G M" | (Vc G 



^Here, [a] denotes the integer part of a 



C) {x*,c) = 0}. The distance function to the set C, written as dist(-,C), is defined by 
X I— 7- infcgc ||x — c||. The projector operator to the set C, denoted by Pc, is defined by 

Pc{x) := {c G C I \\y - c\\ = dist(a;, C)}, Vx G M". 

Let D C M". The distance of two sets: C and D, is dist(C, D) := infcgcderf l|c — d||- Given 
/: X — ;• ] — oo,+oo], we set dom/ := /~^(M). We say / is proper if dom/ 7^ 0. Let / be 
a proper function on M". Its associated recession function /°° is defined by 

f°°{v):= liminf ^^^ for ah t; € M". 

t—>oo,v'—^v t 

If / is further assumed to be lower semicontinuous and convex, one has (see pL< Proposition 
2.5.2]) 

(2.1) r{v) = hm n- + tv)-fi^) = ,^p f{^ + tv)-f{x) ^^^ ^^j ^ ^ ^^^^^ 

t— >co i ^^Q t 

Recall that / : M" — )• M is a polynomial if there exists a number r G N such that 

/(x):= J] A„:c", 

0<|a|<r 

where Aq S M, x = (xi, • • • , x„), x" := x"^ • • • x"", a^ G NU {0}, and \a\ := X]?=i o^j- The 
corresponding constant r is called the degree of /. 

Next let us recall a useful property of polynomial functions. 

Fact 2.1 (See [21 Remark 4]) Let / : M" -> M 6e polynomial, and {xi,X2} C M". // / is 
constant on D := [xi,X2], t/ien / is constant on aSD. 

Following [17], a set I? C M" is said to be semi-algebraic if 

I s 

D:=[j f|{x G M'^ I fijix) = 0, hij{x) < 0} 
i=i j=i 

for some integers /, s and some polynomial functions fij, hij on M" (1<^<^, l<i<s)• 
Moreover, a function / : M" — )• M is said to be semi- algebraic if its graph gph/ := 
{(x, /(x)) I X G R"} is semi-algebraic. 

Recall that a set C C M" is called semi-algebraic convex if there exist 7 G N and convex 
polynomial functions, gj,j = 1, ... ,7 such that C = {x G M" | gj{x) < 0,j = 1, • • • ,7}. 
Clearly, any semi-algebraic convex set is convex and semi-algebraic. However, the following 
example shows that a convex and semi- algebraic set need not to be a semi- algebraic convex 
set. 

Example 2.2 Consider a set A := {(xi,X2) G M^ | 1 — X1X2 < 0, — xi < 0, — X2 < 0}. 
Clearly, A is convex and semi- algebraic while the polynomial (xi,X2) 1— )■ 1 — X1X2 is not 



convex. We now show that A is not a semi- algebraic convex set, i.e., it cannot be written 
as {x : gi{x) < 0, i = 1, •••,/} for some convex polynomials gi, i = 1,- • • ,1, I £ N. To 
see this, we proceed by the method of contradiction. Let / : M^ — ?■ M be defined by 

/ should attain its 



f{xi,X2) := xi. Clearly inf /(x) = 0. Then, then by Fact 2.13 
minimum on A. This makes contradiction, and so, justify the claim. 







We now summarize below some basic properties of semi-algebraic sets and semi-algebraic 
functions. These properties will be useful for our discussion later. 

Fact 2.3 The following statements hold (the properties (PI) and (P4) are direct from the 
definitions). 

(PI) Any polynomial is a semi-algehraic function. 

(P2) (See |17| Proposition 2.2.8].) Let D he a semi-algehraic set. Then dist(-,-D) is a 
semi-algehraic function. 

(P3) (See \n\ Proposition 2.2.6].) // /, g are semi-algehraic functions on M" and A G M 
then f + g, A/, max{ /,(/}, fg are semi-algehraic. 

(P4) If fi are polynomials, i = l,...,m, and A € M, then the sets {x \ fi{x) = X,i = 
1, . . . , m}, {x I fi{x) < A, i = 1, . . . , m} are semi-algehraic sets. 

(P5) (Tojasiewicz's inequality) (See [T7{ Corollary 2.6.7].) If </>, -i/; are two continuous semi- 
algebraic functions on compact semi-algebraic set K C M" such that ^ (j)~^{0) C 
^"""^(O) then there exist constants c > and r G (0, 1] such that 

|V'(x)| < c|(/)(x)|^ for all X G i^. 

Remark 2.4 As pointed out by |38j . the corresponding exponent r in the Lojasiewicz's 
inequality (P5) is hard to determine and is typically unknown. 

Remark 2.5 Let gi, i = 1, . . . ,m he polynomial on R" and let S := {x £ M" | gi{x) < 
0}. Let X £ S. Then, (P2) and (P4) imply that 4> = niaxi<i<m[gi]+ where [gi]+ := 
max{gj(-),0} and Tp = dist(-,5') are semi- algebraic functions. Applying (P5) it follows 
that there exist c, e > and r G (0, 1] such that 



(2.2) dist(x,5) < c max bi(x)]^ for all x G B(x,e). 

l<i<m 







As we have explained in Remark 2.4, the exponent r in (2.2) is hard to determine and 
is typically unknown. However, there are some special cases where we can provide some 
effective estimates on the exponent r: To formulate these results, we first introduce a 
notation below. 



Definition 2.6 Define 

(2.3) K(n,ci) :=(d-l)" + l. 



We now present various results which explain that the exponent r in (2.2) can be 
effectively estimated in the case when gi has some special structure. 

Fact 2.7 (Gwozdziewicz) (See [251 Theorem 3].) Let g be a polynomial on R" with 
degree no larger than d. Suppose that g{0) = and there exists Eq > such that g(x) > 
for all X G 18(0, eo)\{0}- Then there exist constants c, e > such that 

(2.4) \\x\\<cg{x)^<^, VxG]B(0,e). 

We denote by /3(s) the central binomial coefficient with respect to an integer s: (r^rti) 
(with = 1)1 



Fact 2.8 (Kollar) (See f29', Theorem 3(i)].) Let g^ be polynomials on M" with degree < d 
for every i = 1, • • • ,m. Let g{x) := maxi<j<m gi{x). Suppose that there exists ffo > such 
that g{x) > for all x G B(0,eo)\{0}. Then there exist constants c,e>0 such that 

\\x\\ < C5(x)'3("-i)<*", VxGB(0,e). 

Fact 2.9 (See [321 Theorem 4.2].) Let g be a convex polynomial on R" with degree at most 

d. Let S := {x \ g{x) < 0} and x £ S. Then, g has a Holder type local error bound with 

exponent K{n,d)~^, i.e., there exist constants c, e > such that 

1 
dist(a;, S) < c b(x)];<"''> for all x G B(x, e). 

Fact 2.10 (See [32., Theorem 4.1].) Let g be a convex polynomial on R". Let S := {x \ 
g{x) < 0}. Suppose that there exists xq G R" such that g{xo) < 0. Then, g has a Lipschitz 
type global error bound, i.e., there exists a constant c > such that 

dist(x, S)<c b(x)]+ for all x £ R". 

Corollary 2.11 Let gi be convex polynoTnials on R" for every i = 1, • • • ,m. Let S : = 
{x G R" I gi{x) < 0, i = 1, • • • , m}. Suppose that there exists xq G R" such that gi{xo) < 
for every i = 1,- ■ ■ ,m. Then, for every compact subset K ofW^, there exists c > such 
that 

dist(x,5) < c max [(7j(x)]+ for all x £ K. 

l<i<m 

Proof Let i^ be a compact subset of R". We will prove it by the induction on m. When 



m = 1, the conclusion follows by applying Fact 2.10 directly. Suppose the statement holds 



when m = p — l,p £ N\{1}. Then, there exists a constant cq > such that 
(2.5) dist(x, Si) < Co max [5rj(x)]+ for all x G -fC, 

l<i<p— 1 



where S*! := {x G M" \ gi{x) < 0,i = I,- ■ ■ ,p - 1} 

Now we consider the case of m = p. Set S2 '■= {x G M" | gp{x) < 0}. Then xq E 
int Si n int 82- By [6l Corohary 4.5], there exists 7 > such that for every x £ K 

dist(2;, S) = dist(x, Si n S2) < 7max | dist(x, Si), dist(a;, 6*2)} 

<7maxico max [gi{x)]^, dist{x, S2)\ (by ([2^) 
L i<j<p— 1 J — 



< 7max< Co max [gi{x)]+, ci[gm{x)]+ \ ( 3ci > by Fact 2.10) 

L l<i<n— 1 J ' ' 



i<p— 

< c max[5ri(x)] + , 
i<j<p 

where c := max{7Co,7Ci}. 

Thus, the conclusion follows by the method of induction. D 



The following example will show us that the conclusion of Corollary 2.11 can fail if we 
allow K to be noncompact. 

Example 2.12 (Shironin) ( See ^ Example 4.1] or g^.) Let 51,52 : M^ ^ M be 
defined by 

gi{xi,X2,X3,X4) := xi, 

g2{xi,X2, X3, X4) := xf + X2 + X3 + xiX2x| + xfxjxl + x\x\ + x\x\ 

"P X1X2 ~r XiXo ~r Xi ~r X2 \ Xq X4. 

Then 51,52 are convex polynomials and 

5i(-/i:,0,0,A:^^ + /c2 + A;) = 52(-A;, 0,0, A;^*' + A;^ + fc) = -A: < Q, V/c G N. 
On the other hand, as shown in |1^, there exists a sequence (xfc)fcgN in I^^ such that 

max{[5i(xfc)] + , [52(2^^;)]+} < 1, V/c but dist(xfc,5') — > +00, 
where S" := {x G M"^ | 51 (x) < 0,52(x) < 0}. 

We now summarize some basic properties of convex polynomials that will be used later. 
The first property is a Frank- Wolfe type result for convex polynomial optimization prob- 
lems while the second one is a directional constant property for a convex polynomial. 



Fact 2.13 (Belousov) (See [HI Theorem 13, Section 4, Chapter II] or [HI Theorem 3] 
and ^39j-) -^et f he a convex polynomial on M". Consider a set D := {x \ gi{x) < 0,i = 
1, • • • ,m}, where each gi, i = 1,- ■ ■ ,m, is a convex polynomial on M". Suppose that 
infxeD f{x) > —00. Then f attains its minimum on D. 
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Fact 2.14 (See [U Propsition 3.2.1].) Let f be a convex polynomial on M" and v G M". 
Assume that f°°{v) = 0. Then f{x + tv) = f{x) for allt gR and for all x G M". 

From now on we assume that 



m G N, 7i G N, i = 1, . . . ,m 




gi,i,gi,2, ■ ■ ■ , gi,^, are convex polynomials onM", i = 1, . . . ,m 




a := {x G M" 1 g^,l{x) < 0, gi,2{x) < 0, • • • , gi,^^{x) < o}, i = 1, . 


. ,m 


Pi:=Pc^, Vi = l,2,---,m 




C := Pi Ci / 0. 




1=1 





Fact 2.15 (Bauschke and Borwein) (See [71 Lemma 2.2 and Theorem 4.8], or [6l 
Fact l.l(iii) and Fact 1.2(ii)].) Let A,B be nonempty convex subsets of W^ such that 
A — B is closed. Let bo G X and {ak)keN, (^fc)fceN be defined as below: 



Ofc+l •= PAbk 
bk+i '■= Pso-k+i- 



Let V := Pa-bO- 



(i) \\v\\ =dist{A,B) and Ok 



a + V. 



{ii) Pbx = PBn(A+v)X = x + v,yx e An (B-v) and P^y = PAn{B~v)y = y-v,'^y ^ 
Bn{A + v) 

Definition 2.16 Let A be a nonempty convex subset o/M". We say the sequence {xk)k£n 
in M" is Fejer monotone with respect to A if 

\\xk+i — a\\ < \\xk — a\\, \/k £ N, a £ A. 

Fact 2.17 (Bauschke and Borwein) (See [Si Theorem 3.3(iv)].) Let A be a nonempty 
closed convex subset ofW^ and {xk)k<^N be Fejer monotone with respect to A, and Xk — > 
x £ A. T/ien ||x„ — x|| < 2 dist(x„,j4). 

Fact 2.18 (Bregman) (See [ISj.) Let xq G M". The sequence of cyclic projections, 
ixk)kGN, defined by 

(2.6) Xl := PlXo,X2 ■■= P2XI,--- ,Xm ■■= PmXm-l,Xm+l ■= PlXm ■ ■ ■ 

converges to a point in C. 



3 Holderian regularity for semi-algebraic convex sets 

In this section, we will derive the Holderian regularity for semi-algebraic convex sets and 
provide an effective estimate of the exponent in the regularity results. This result plays 
an important role in quantifying the convergence speed of the cyclic projection methods. 

To do this, we first establish an error bound result which estimates the distance of a 
point to a semi-algebraic convex set S in terms of the polynomials that defines S. More 
explicitly, we derive the explicit exponent r > such that there exist c, e > 0, 



dist(a;,S') < c max [gi{x)]+ whenever \\x — x\\ < e, 

\ l<i<m J 

where S := {x £ M" | gi{x) < 0,i = !,••• ,m}. We note that the error bound prop- 
erty plays an important role in convergence analysis of many algorithms for optimization 
problems as well as variational inequality problem [6'6\ [571 HO] ) and the exponent r in the 
error bound property has a close relationship with the convergence rate of the algorithm. 
However, existing results such as the powerful Lojasiewicz's inequality do not provide any 
insight on how to explicitly estimate the exponent r. 

Before we proceed, let us use a simple example to illustrate that the exponent r can 
be related to the maximum degree of the polynomials defined the semi-algebraic convex 
set and the dimension of the underlying space. This example is partially inspired by [291 
Example 1]. 

Example 3.1 Let d be an even number. Consider convex polynomials gi, i = 1, ... ,n on 
M" given by gi{x) := xf and gi, i = 2,- ■ ■ ,n given by gi{x) := xf — Xj_i, i = 2, • • • ,n. 
Then, direct verification gives us that 5 := {x G M" | gi{x) < 0, i = 1, • • • ,n} = {0}, and 
so, dist(x,S') = ||x||. In this case, consider x{t) = (i'^" ,t'^" ,••• lO £ I^") t £ (0)1)- 
Then dist(rc(t), 5") = 0{t) and maxi<j<m[5i(2;(t))]+ = t . Therefore, we see that if there 
exist c, e > and r > such that 



dist(x,5) < c max [gi{x)]^ whenever \\x\\ < e, 

y l<i<m J 

then, T < ^. Thus, we see that the exponent r is related to the maximum degree of the 
polynomials defined the semi-algebraic convex set and the dimension of the underlying 
space. 



We now introduce a decomposition of the index set. 

Definition 3.2 For convex polynomials gi, ■ . . ,gm on M" with S = {x £ M" | gi{x) < 
0, i = 1, . . . , m}, the index set {!,..., m} can be decomposed as Ji U J2 with Ji n J2 = 
where 

(3.1) Ji:={ie{l,...,m}\gi{S) = 0} and J2 := {1, . . . , m}\Ji. 



Now we come to our key technical result. 

Theorem 3.3 (Local error bounds for convex polynomial systems) Let gi be con- 
vex polynomials on M" with degree at most d for every i = 1, • • • , m. Let S := {x G M" | 
9i{x) < 0, i = 1, • • • , m} and x £ S. Then there exist c,e>0 such that 



dist{x,S) < c max[(7j(x)]+ + (max[(^j(x)]+) whenever \\x — x\\ < e, 

where [a]+ := max{a,0}, r := may: { ^^^.^^y f3{n-i)d" }' '^i^^'^d) := (2d-l)'' + l, /3(n - 1) 
is the central binomial coefficient with respect to n — 1 which is given by (r(„"^)/2i); '^^nc? 



Ji, J2 are defined as in (3.1). 



Proof. We prove the desire conclusion by induction on the number of the polynomials m. 
[Trivial Case] Suppose that m = 1. Then Ji = {1} or Ji = 0. If Ji = {!}, then the 



conclusion follows by Fact 2.9 since max { ^(„\^-) , s(n-i)d" } — K(n d) • ^^ "^i ~ ^^ then there 



exists xo such that 51 (xq) < 0. In this case, the conclusion follows by Fact 2.10 



[Reduction to the active cases] Let us suppose that the conclusion is true for m < 
p — 1, p G N, and look at the case for m = p. li Ji ^ {1, . . . , m}, then {1, . . . , m}\Ji 7^ 0. 
Let io ^ Ji. Then there exists xq G S* such that gig{xQ) < 0. Set Jq := {i G {1, 2, . . . , m} \ 
gi{xo) < 0}. Then io £ Jo ^Z J2 and Jq n Ji = 0. Let A, B be defined by 

A := {x G M" I gi{x) < 0, Vi G Jq} 
B := {x G M" I c/i(x) < 0, ViGJ}, 

where J := {1, 2, . . . , ?tt-}\ Jq. Thus, Ji C J. Then we have xq G int ^4 n -B and S = Ar\B. 
Since S '^ B, we have 

(3.2) Ji := {i G {1, 2, . . . , m}\ Jo | gi{B) = O} C J^. 

Since int^ D B ^ f/>, [6, Corollary 4.5] implies that for every compact set K there exist 
7, 5 > such that 

(3.3) dist(x,S') = dist(x, AnB) < 7max{dist(x, A),dist(x, 5)} for ah x £ K. 



By Corollary 2.11, there exists ci > such that 



(3.4) dist(x,A) < ci max[5rj(x)]+, Vx G K. 

ieJo 



From the induction hypothesis and ( |3.2[ ), we see that there exist e > and C2 > such 
that for every ||x — x|| < e, maxi<j<m[(7j(x)]+ < 1 and 

dist(x, B) 



< C2[ max^[gi{x)]+ + (max[gi(x)]+)^ 
.ieJ\Ji ieJi 



C2 ( max { max [(7j(x)] + , ma3^[gi(x)] + } + (max[gj(x)]+)^ j (since Ji Q Ji Q J) 
ieJ\Ji ieJi\Ji ieJi 



< C2( max [5i(2;)]+ + ma5^[5ri(x)]+ + (max[5ri(a;)]_ 
.«eJ\Ji ieJi\Ji iGJi 



< C2( max [5i(2;)]+ + ( max_[gi{x)]+y + (max[fl'j(x)]+)'' 
.«eJ\Ji ieJi\Ji ieJi 



< C2 ( mjix [gi{x)]+ + 2(max[gj(x) 
ieJ\Ji *eJi 



< 2c2 mxix [5j(x)]+ + ( max[gj(x) 
.JeJ\Ji *e-^i 



Thus the conclusion follows in this case by combining (3.3) and (3.4). 
From now on, we may assume that Ji = {1, . . . , m}, that is, 

{x\ gi{x) <0,i = l,--- ,m] = {x\ gi{x) = 0,i = 1,- ■■ ,m]. 
This implies that inf^gj^n maxi<j<m{gi(x)} = 0. Then, 



Or- ^ {(5i(x),--- ,gmix)) \ xGR"}+int] 



"+• 



Hence the convex separation theorem gives us that there exist Oj > with YlT^i Q^j = 1 
such that Xli^i ^i9i{x) ^ for all x G M". Denote / := {i | Oj > 0} 7^ 0. Then, we have 
Yjiei «i = 1 and 

(3.5) ^ aigiix) > for ah x £ M". 

ie/ 

[Decompose the underlying space into sum of t^vo subspaces M and A/-*-] Con- 
sider D := {x £ M" I 5j(x) < 0, i G /}. Clearly, Z? is a convex set and x £ D. Moreover, 



for any v £ D, (3.5) implies that 



(3.6) gi{v) = 0, Vi G I. 



In other words, gi takes constant value on D. Then, Fact 2.1 implies that D is either a 
singleton or an affine set with dimension larger than one. 

Let M := D — X. Then M is a subspace. We may decompose M" = M + M . Denote 
dimM = k {k< n). 

We now see that 

(3.7) ^gf{x) > for &l\x-x£ M^\{0}. 

Otherwise, there exists xq £ M" such that xq — x £ M-^ and gi{xQ) = for all i £ I. This 
shows that xq £ D. Thus xq — x £ M and hence xq — x £ M n M-*-. This contradicts to 
the fact that j;o ~ 2; 7^ 0. 
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Similarly, we have 



(3.8) 



m.a:x.gi{x) > for all x — x G M \{0}. 



[Distance estimation on M ] Now we first show that there exist Eq, 70 > such that 



(3.9) 



\x — x\ 



iei 



•i{n — k,2d) 



\fx-x GM-^nB(0,eo) 



Since diniM-'- = n — k, there exists an n x {n — k) matrix Qq with the rank n — k such 
that Qq{W^-'^) = M-L. Then Qq is a bijective operator from W^''^ to M^. Then ^?j\ 
shows that 



(3.10) 



^5'(x + Qo6)>0, V6gM"-M0}. 



Define h : 



■ TCPn-fc 



by h{b) := Eiei9ti^ + Qob). Then h{0) = Eieidfi^) = by Q. 



Thus by (3.10) and Fact 2.7, there exist £1,71 > such that for all 
\\b\\ < ^ih{b)^<^^^^) =^J^gf{x + Qob) 



1 

K(n-fc,2d) 



<ei. 



iei 



Setting X := X + Qob, it follows that 

||x-x|| = \\Qo{Qq^{x- x))\\ < IIQoll • \\Qo^{x- X 



1 

«(n-fe,2d) 



\/\\Q,\x - x)\\ < ^1- 



iai 



Then, there exist 61,71 > such that 

\\x-x\\ <7of ^gfix) 
^ iei 



K{n — k,2d) 



Vx-x £M-^nM{0,eo). 



Hence (3.9) holds 



By Fact 2.8 and (3.8), there exist £0170 > such that eo < £0 and, for all x with 



x-xG M-^nB{0,eo) 



and 



max(7j(x) < 1 



(3.11) 



|x — x|| < 7o( max(7j(x) 



70 max[5ri(x)]. 



,8(n-fc-l)d"-'= 



;3(n-fc-l)d"-fe 
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[Distance estimation on M] Set r := < 



max{ ^^^^\^'>"^ \i£l}>0, if|/|>2; 
1, otherwise. 

Thus r > 1. Note that X^jgj aigi{x) > 0, we have for each i G / 



r / M ^ / ^ ^ Y.j<^I\{i\(^39j{^) ^ r / M 

max[5i(x)J+ > 5rj(x) > > -r max[5i(x)J- 

ie/ a,- is/ 



Hence we have |5'i(x)| < r maxjg/[(7j(x)]+. This together with (3.9) imphes that 



«(n-fe,2d) 

k-xll < 7or^|/|( max[5(i(x)]+ ) , Vx - x G M"^ n]B(0,eo)- 

is/ 



Combining this with (3.11 ), we see that, for every re — x G M n B(0, Eq), 
(3.12) ||x - x|| < (7or |/| +70) max[5i(x)] + 

We now consider two cases. 

Case 1: dimM = {0}. 

We have D = S = {x}. Thus M = and M^ = M". We can assume that 
maxjg/[5rj(x)]+ < 1 for ah x — x G 18(0, eo)- Then by ( |3.12[ ), we have 

^ . , - t K(n,2d) '/3(n-l)d" J 

dist(x, 5) = ||x - x|| < (7or |/| + 70) ( max[5j(x)]+ 



ie/ 



V||x — x|| < £0- 



Case 2: k = dimM > 1. 

Since dimM = k, there exists a fuU rank matrix Q G M"^'^ such that (5(1^'^) = M. For 



each u ^ M and i ^ I, (3.6) imphes that 



t— >oo t 



Then, Fact 2.14 imphes that 

(3.13) gi{x + u) = gi{x) for ah x G M",n G M,i G /. 

Since S '^ D = x + M, it follows that 

S = {xGx + MgM"| gi{x) <0,i^I} = x + Q{S), 

where S := {a G M^ | gi{x + Qa) <0,i^ I}. 

Note that £ S. The induction hypothesis implies that there exist £1,71 > such that 
maxj^/[5rj(x + Qa)]+ < 1 and 

^ ' tor all a < ei. 



dist(a, 5) < 71 1 max[g(j(x + Qa)]- 
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This implies that there exist e2 , 72 > such that 

^^\,^(fc,2d)'^(fc_l)dfe/ 



(3.14) dist(x,5) < 721 max[gj(x 



for aUx-xG Mn]B(0,e2)- 



[Combining the estimation and simplification] Now let e < min{eo',e2} be such 
that maxi<j<m[gi(x)]+ < 1 for all x E B(x,e). Let i^ be a compact set contains M(x,e) U 
]B(0, e). Denote the Lipschitz constant of (7j over ii' by Lj, i.e., \gi{xi)—gi{x2)\ < -Li||xi— X2II 
for all xi, X2 G K. Set L := maxi<j<m Li and 7 := max{7or^|/| + 70)72}- 

To see the conclusion, we only need to show that for any x E M{x, e), 

^^ \ K.(n,2d) ' /3{n-l)d" J 



dist(2;,S') < c max [gi{x)] 

\ l<i<m 

where c := 27 + ^7^. To see this, let us fix an arbitrary x E M{x,e). Note that M" = 
M + M . Then, one can decompose x — x = u + v for some u E M n IB(0,e) and 



t; E M-L nIB(0,e). This together with (3.14) and (3.12) implies that 



(3.15) dist(ti + X, S) < 7( ui8ix[gi{u + x)]^ 



m 



(3.16) 
Therefore, 



lull < 71 max[(7j(u + 3;)]_|- 



[^ \ ) 

■ L K{fc,2d) ',3(fc_l)dfc J 

^/ 2 ^ 1 

I K(n-fe,2d) '^(„_fc_i)d"-fc J 



dist(x, 5") < dist(u + x, S*) + ||x — (n + x) || 
= dist(n + X, S*) + ||f II 

^^ 1 K(fc,2d) ' jQ~Tjdk S 



<j[ uiax[gi{u + x) 



+ 7 max[fifj(?; + x)]_ 
el 






k,2d) ' fi{n-k-l) 



l)d"-k J 



7 inax[gi{u + x) 



< 7 max [gi{u + x)]- 



™^=^|K(fc,2d)'^(fc_l)dfc/ 



+ 7 max[gi(x)] + 



i(n,2d) ' fl{n 



1 I 

-l)d" J 



/^ 1 \ 

- I K(k,2d) ' p(k-l)dl' J 



+ 7 max [sfi(x)] 

l<i<m 



[^ 1 \ 

- \ K(n,2d) '/3(n-l)d" J 



where the second equality follows by (3.13) and v + x + u = x. Note that 



max [5j(n + x)]+ - max [fl'i(x)]+| < max \gi{u + x) - gi{x) 

l<i<m l<i<m l<i<m 



<L||u + x — x|| =L||t;| 



< L^[ m.ax.[gi{v + x) 

is/ 



/ 2 

" L K(n-fe,2d) ' ^ 



(3.17) = L7 max[g'i(x)]_ 
ie/ 



I3(n--k~l)d"-k 

I 2 1 1 

L K(n-fc,2d) ' /3(n-fe-l)d"-fc ' 



} 



(by (|3l6)) 



(by 3.13) and v + x + u = x). 
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As m.axi<:i<m[giix)]+ < 1 for all x G B(x,e), it follows that 
dist(x, S') < 7 max [gi{u + x)]+ I +7 max [17^(2:)]+ 1 

\ l<i<m J \ l<i<m J 

2 

< 7f max [g,{x)]++Lj{max[g,{x)]f^^^)) """"' (by pl7| ) 

V l<i<r?i 2G7 / ' ' 

/ ^ max I ^(„^2<i) ' FTTr^T)d^ | 

+ 7 max [5i(a;)] + 

2 

< 7f max [g,{x)]f^^^ +Lj{maMx)]f^^^)) """'"' 
+ 7 max [gi(a;)] + 

\ l<2<m / 

4 / \ "13-'^ \ „(„,2d) ■ ^(n-ljd" J 

< (7 + ^7^) max [g,(x)];<""''''""''<''"" +7 max [g^{x)] + 

= (7 + ^7 ) max [gj(a;)]_;^ ' +7 max [g^{x)] + 

(3.18) 

2 / \ ™ax I „(„^2d) ■ fl{^-l)d^ I 

< (7 + ^7") max [g,{x)]^'-''"+' +7 max [5,(x)] + 

l<i<7n \ l<i<m J 

Similarly, we also have 

dist(x,S') < 7 max \g^[u + x)\+ +7 max \g.Xx)\ + 

< 7f max [g,(x)]+ + L7(max[g,(x)]^<"-^-^"^"-'= )) '*'"''' (by ^^) 

/ y"^^{7;(765)' g(..-l)^" } 

+ 7 max {gi{x)\ + 

< 7f max [g,(x)]r"^^^^^ +L7(max[5.(x)]r^"^^^^)) "^"'^' 

/ ^ max I ^(„^2d) ' pT^r^TTdTT / 

+ 7 max [5i(a;)] + 

\ l<i<m / 

2^ r / ,, (^(„-fe-l)d"-k).(;3(fc-l)d'^) / ^ , ,, \™ax|^^^^,^(„_\j^„| 

= (7 + L7 ) max \g.Xx)\X ' +7 max [5^(0;)] + 

< (7 + L72) max [ft(a:)] «"-""" +7 max [g,(x)] + 

l<i<r?i V l<i<m J 

where the last inequality was obtained by the Chu-Vandermonde identity. 
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In combination with (3.18) we obtain 



,max * 



dist(2;,5) < (7 + L72) max [g,(x)]r" ^ <'"-''"+''"<"-'"*" ^ +7( max [g,(x)j + 

l<i<Tn V l<'i<m 

= (27 + L7^) max Mx)]^ 

l<'t<m 



\ (2d-l)"+l'/3(n-l)d" / _|_^,( ^^^ r^.l'^M . 1 

/ 2 1 \ 

1 (2d-l)" + l -/SCn-ljd" J 

This completes the proof. D 



As a corohary, we obtain a local error bound result which is independent of the partition 
of the index set. 

Corollary 3.4 Let gi he convex polynomials on M" with degree at most d for every i = 
!,••• ,m. Let 5 := {x G M" | gi{x) < 0,i = 1, • • • ,m} and x G S. Then there exist 
c, e > such that 



dist(a;, S) < c( max [(/j(x)]+ ) whenever \\x — x\\ < e, 

\ l<i<m ) 

where \a\j^ := max{a,0|, r := max | , ^„ .^ , ^ — Wt^-J = r ,^. -,,nK r and 

L J+ I ' /; \K(n,2d)'/3(n-l)<i"/ min { t^''"'^) +\ /3(n-l)d"} 

/3(n — 1) is i/ie central binomial coefficient with respect to n — 1. 

Proof. Choose e small enough so that maxi<j<m[<7j(x)]+ < 1. Then, the conclu- 



sion follows immediately from the preceding Theorem 3.3 by noting that [(7j(x)]+ < 



[maxi<i<rn[giix)]+) "("'^d) fQj. gach i = 1, . . . , m. D 

Remark 3.5 (Discussion on the exponent) Let gi be convex polynomials on M" with 
degree at most d for every i = 1,- ■ ■ ,m. Let 5 := {a; G M" | gi{x) < 0, i = 1, • • • , m} and 
x £ S. We now form some discussion on the exponent in our local error bound results. 



(1) Theorem 3.3 shows that in the case when d = 1 or there exists xq G M" such that 
(7j(xo) < 0, i = l,...,m, we indeed obtain the Lipschitz type local error bound. 
That is to say, in these cases, there exist c, e > such that 

dist(rc, S) < c max [5'i(x)]+ whenever ||x — x||<e, 

l<i<m 

where [a]^ := max{a,0}. To see this, if d = 1, then ,^ ^d) ~ ^ ^^'^ gfa-Dd" — ^' 
So, T = max { i^r.^2d) ' B(n-i)d" } ~ ^ ^^"^ ^^^ conclusion follows immediately from 
Theorem |3.3[ On the other hand, if there exists xq G M" such that gi{x{y) < 0, 
i = 1, . . . ,?7i, then, Ji = 0. So, the conclusion follows immediately from the same 



theorem, and also recovers Corollary 2.11 



(2) In the case when n = 1, we see that ^i^2d) ~ /3(n-i)d" ~ \- ^°' when each gt is a 
univariate convex polynomial, then there exist c, e > such that 

dist(x,5') < c( max [gi{x)\j^)^ whenever \\x — x\\ < e, 

l<i<m 

which seems to match what one might expect in this case. 
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(3) On the other hand, m general, our estimation on the exponent will not be optimal. 

For example, if the inequality system consists of one single convex polynomial, Fact 
2.9 shows that the exponent can be set as M_i"')n . ^ while our results produce a 
weaker exponent max { (2d-i)"+i ' B(n-i)d^ } ■ ^^ interesting feature of the exponent 
M_iV+i ™ ^^'^^ 2.9 is that, in the convex quadratic case, it collapses to ^ which 
is independent of the dimension of the underlying space and agrees with the known 



result presented in 

By contrast, our estimate max {yrri, B(n-i)2" } '^hich depends heavily on the dimen- 



sion n. Moreover, as indicated in Example |3.1[ the best possible exponent might 
be ^ (see [29] for some relevant discussion regarding the best possible exponent for 
general nonconvex polynomial system). It would be interesting to know how one 
could improve our estimate here. 

Making better sense of these estimates will be one of our future research topics. 



Given D C M", we set dist''(-, D) := ( dist(-, D)y for every rGR. 

Theorem 3.6 (Holderian regularity) Let 9 > and iC C M" be a compact set. Then 
there exists c > such that 

dist''(x,C7) < c( ^dist''(x,Ci) J , Vx G K, 
where r := r (2d-n"4-i T ^'^'^ /^('^ ~ 1) *s the central binomial coefficient with 

min I i ^' ,/3(n— l)(j" | 

respect to n — 1 which is given by {\/^i)/2]) ■ 

Proof. To see the conclusion, we only need to show that for each x S M", there exist 
c, e > such that 

(3.19) dist'^(x,C) < c( y dist^(x,Ci) ) , for ah ||x - x|| < e. 



/ XT 

dist'^(x, C)<c[Y^ dist^(x, d) J , for ah 



Indeed, granting this and fixing a compact set K, then for any x G K there exist Cx,£x > 
such that 

. m XT 

dist^(x,C) < Cx I \Jdist^(x,Cj) j , for all ||a; — x|| < Ex- 
^ i=i ^ 

As K is compact and Use-fc ^(^' ^^) — ^' ^^ ^^^ ^^'^ finitely many points xi,- ■ ■ ,Xs £ K, 
s £ N, such that IJi=i ^(^i! ^sj 2 K. Let c := max{c;rj , • • • , c^^}- Then, for any x £ K, 
there exists io G {1, • • • , s} such that x £ M{xi^^; Ex^ ), and hence 

(m -.T/m XT 

ydist^(x,C,)) <c(ydist^(x,a)) . 
i = l ^ ^ 4 = 1 ^ 
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We now show (3.19) holds. Fix x G M". We consider two cases. 

Case 1: x ^C. 

Then there exist ei, 77, M > such that 

m 

^ dist^(x, d) > r] and dist^(x, C) < M for ah ||x - x|| < ei. 



M ^T ^ M ( v^m 



Therefore, dist^(x,C) <M= fr]^ < ff ( EI!Li dist^C^^. <^i) ) for all \\x - x\\ < ei 



and 



hence, (3.19) holds. 
Case 2: x e C. 
We have 

C= jxGM" \gi,i{x) <0,gi,2ix) < 0, • • • ,g^,^^ix) < 0, i = l,--- ,m}. 



By Corollary 3.4, there exist positive constants cq and 6 such that 



dist(x,C) < C|f ( max {[gi^i{x)] + ,--- ,[gi^y^{x)]+}] , y\\x - x\\ < 6. 

y l<t<m J 

Hence 

(3.20) dist^(x,C) < co( max {[5rj_i(x)]+, • • • , [5rj,^^(x)]+} ) , V||x-x||<5. 

Now we claim that there exists /? > such that 

max {gi^i{x)] + r-- ,[9irHi^)]+}) < /? V dist^(x, Q), y\\x - x\\ < 5. 

l<i<m I ■^ — ' 
/ j=l 

Suppose to the contrary that there exists a sequence (a;fc)fcgN in B(ic, 5) such that 
max {[5i,i(2;fc)] + ,--- ,[5i,^^(xfc)] + } ) > A: V dist^(xfc, C,), V/c e N. 

' i=\ 

Without loss of generality, we can assume that gi^i,gi^2, ■ ■ ■ 9i,-yi have the Lipschitz constant 
L > on B(x,(5) for every i = 1,2,- ■ ■ ,m. Then, there exists a subsequence (xfc,);gN of 
{xk)keN, 1 < ^0 < "T- and I < jo < 74,, such that 

max {[5i,i(xfcJ] + , • • • , [gi,j,{xk,)] + } = [9io,joixh)] + , V/ G N. 

l<i<m. 



It follows from (3.22) that 



(3.23) {ho,Joi^k)]+Y > hJ^d^^^^i^krCi), yi G N. 



j=i 
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Then [fl'io,jo(^fci)]+ = 9io,joi^h) ^-nd hence for every I £ N, 
(3.24) 

m m 

{giojoi^k)) > k'^dist^ixki, Ci) = ki'^\\xki - Piixki)\\ > ki\\xki - Pio{xki)\\ ■ 



4 = 1 j = l 



Since Pio{xki) G Ct^, we have gio,ja[Pio{xki)) < and \\xki - Pioixki)\\ < Ikfc, - x\\ < 6 by 
X G CjQ. Combining this with (3.24[), we have 



L^||xfc, -Pio{xki)\f > [gioJoixki) - gio,jo{Pioixh))) > ki\\xki -Pio{xkt)\f, V/ G N. 
Hence we have L^ > ki for every / G N, this contradicts the fact that ki — >■ +oo. Thus, 



(3.21) holds. 



Combining (3.21) and (3.20), we see that 



dist^(x,C) <co;5^(^dist^(x,Ci)j , V||x-x||<5, 

i=l 

and so the conckision foHows. D 



4 Convergence rate for the cyclic projection algorithm 

In this section, we derive exphcit convergence rate of the cycHc projection algorithm 
applied to finite intersections of semi- algebraic convex sets. 

Before we come to our main result, we need the following useful lemma. 

Lemma 4.1 (Recurrence relationships) Let p > 0, and let {5fc}fcLo ^'^^ {/^fcjfcLo ^^ 
two sequences of nonnegative numbers satisfying the conditions 

(3k+i < Ml - Skl3l) as A: = 0,1,.... 

Then there is a number 7 > such that 



(4.1) /3fc< r/3o-P+pJ]<5iV /ora// A:GN. 

^ i=o ^ 

We use the convention that ^^ = +00. In particular, we have lira (3k = whenever 

00 



00. 



A:=0 



Proof. It follows from our assumption that 

< A+i < ft < • • • < /3o and (5,/3f+^ < ft - ft+i as f G N. 
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Fix A: £ N. We consider two cases. 
Case 1: /3fc = 0. 



Clearly, (4.1) holds. 



Case 1: ^k^O. 

Thus /3fc > and hence /3j > for every i < k. Define the nonincreasing function 

h : M++ -^ ]-cx),+oo] by h{x) := x-^p+^1 As 6ih{Pi)-^ = 6i(3f^^ < Pi- /3i+i, then we 
get 

Si < {Pi - A+i)/i(ft) < / h{x)dx - ''+^ '^^ 



This implies that 

(4.2) Pl^^ - /3~P > p6i for ah i G N U {0}. 



Now fix any /c G N and, summing (4.2 ) from i = to i = k — 1, we get 

fe-i 



Pk'-i3o'>pE^^ 



i=0 



which implies the conclusion in (4.1). D 



We are now ready for our main result: Theorem 4.2 The proof follows in part that of 
Lemmas 3&:4], one may also consult [8]. 



Theorem 4.2 (Cyclic convergence rate) Suppose that d > 1. Let xq G M" and the 

sequence of cyclic projections, {xk)keN> be defined by 

Xi . — -TiXq, X2 ■ — J~^2^1j ■ ■ ■ ; ^m ■ — -^m^m—lj ^m+1 • — -^ l^^m • • ■ ■ 

Then x^ converges to Xoo £ C , and there exists M > such that 

\\xk-Xoo\\<M—. V/cGN, 
kP 

where p := ? t- and B(n — 1) is the central binomial coefficient with 

min|(2d-l)"-l,2/3(n-l)d"-2| 

respect to n — 1 which is given by (fr„"ri1/2l)' 



Proof. We denoted by Ui := {i mod m) + l,Vi G N. Thus 2:^+1 = Pc^ Xk- By Fact 
there exists Xoo S C such that x^ — > x^o- 

We first follow closely the proofs of |261 Lemmas 3&:4] to get that 
(4.3) dist'^ixk, C) - dist2(xfc+i, C) > dist^(xfc, C«J, \/k G N. 
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2.18 



We have 



dist^(xfc,C) -dist^{xk+i,C) > \\xk -Pc^^fclP - ||a^fc+i - Pc^kl 



kfc - Pcxkl 



\Pat:Xk - Pcxkl 



\xk - Pcxkl 



\Pat:Xk -Xk+Xk- PcXkl 



= \\xk - PcXkW"^ - \\PakXk -XkW"^ - \\xk - PcXkll"^ + 2(xfc - PakXk,Xk - PcXk) 

:_ \\Xk -'afc^^fcll + ^\Xk ^af^Xk, Xk i'^cif^Xk + r^^Xk J~^CXk/ 

— II^A; -t'^af^XkW ~v ■^\\Xk -t'^a^XkH + '^'{Xk ^a^Xk, tr^a^Xk ^CXk) 

> \\xk - Pa^XkW^^ = dist^(xA;, Ca^), Vfc G N. 



Hence (4.3) holds. 



Next we claim that for every i G N 
(4.4) dist(j;fc, C^^) < dist(xA;, Cq,J + disi{xk+i,Cak+-^) + • • • + <X\s{.{xk+m-i,Ca 



y-k + m-lJ- 



To see this, note that there exists iq <m — \ such that ajg+fc = aj. Then, we have 



Xin+k\ 



(^iQ+k-^1.0 
= \\Xk — J'^akXkW + • • • + \\Xig-\-k-l ~ Paig+k-iXio+k-l\\ + ll^^io+fc ~ Pai^+hXig+k 

= dist(xfc, CaJ + dist{xk+i, Cak_^^) -\ h dist(xio+fc, Ca^^^+J 

< dist(xfc, CaJ + dist{xk+i, Ca^^^) -\ h dist{Xk+m-l,Cak+^_-^ 

Hence (Ol) holds. 



(by io<m- 1). 



Thus by (4.4), 



dist (xk,Ca-) < [rn max dist(xj,Ca. 

^ k<i<k+m-l 



(4.5) < m^(^dist^(xfc,CaJ + dist^(xfc+i, Ca^^^J + ... + dist^(xfe+m-i, C'q,j^+„_Jj . 



By Theorem 3.6 and Fact 2.18 there exists cq > such that 



i=l 



dist2(xfe,C) <co(^dist2(xfc,C7i))'', VA: G N. 

i 

where r := min \^- ^ , f^{n — l)(i"}. 
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Then by (4.5), for every 

^dist2^(xfc,C) 



fceN, 



m 

< > dist^{xk, Ci) < m maj 

i=l 

' +r?i— 1 

^ dist^(xi,C) 

i=k 



iist^fxt, Ci 



max dist (x^ 

_<j<m 



; >-^J^ 



; (j;^, (7q-j.) + dist (j;fc_j_i, Cq,j.^-^ 



< m' 



(4.6) =m^( dist^(j;fc, C) - disi^ {xk+m, C) 

Thus we have 

(4.7) 



+ . . . + <llSt^{xk+m-l,Ca,^^^ 

-dist2(x,+i,C) (byQ) 



Now fix ka G N. Let /3j : 
(4.8) 



dist^(xfc+m, C) < dist^(xfc, C) ^— dist^''(xfc, C). 

:= dist^(xfco+im, C), Vi E N U {0}. Then pj] ) shows that 



ft+i < A - ^/?r = A(l - ^/3[-'^ 



By Lemma 4.1 



dist'^ {xk„+im,C) = A < f/31-'^ + (r 






1 \ """l 



Thus there exits Mq > such that 

dist{xko+im, C) < Mo 2(r-ur ^ Vi G N 

have there exits Mi > such that 

1 



VieN. 



dist(xfc,C)<Mi ^^^_ 



= Mi-^, VA;GN, 



Hence we 
(4.9) 

where p := ? ,-. 

min|(2d-l)"-l,2/3(n-l)d"-2| 

We have 

(4.10) \\xk -Xooll < \\xk - Pcixk)\\ + \\Pc{xk) -a:;oo|| = dist(xfc,C) + \\Pc{xk) - 
By [261 Lemma 3], 

\\xk+i - Pc{xk)\\ < \\xk - Pc{xk)\\ = dist(xfc,C), 
Taking / — > 00 in the above inequality, we obtain that 

(4.11) \\xoo-Pcixk)\\<dist{xk,C). 



Xoo I 



V/ gN. 
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Combining (|4lol), (|4TT| and K9^ 



(4.12) ||xfc-2;oo|| < 2dist(xfc,C) < 2Mi — , VA; G N. 

Thus, the conclusion foUows by letting M := 2Mi. D 

As a corollary, in the case of two sets with nonempty intersection, we obtain the following 
estimate on the convergence rate of the alternating projection algorithm. 

Corollary 4.3 (Alternating convergence rate) Let A, B be defined as in Theo- 
rem ^.1 . Suppose that A D B ^ Q> and d > 1. Let the sequence {{ak,bk)} be generated 



by the alternating projection algorithm (see Subsection ^.i). Then, a^^bk — > c G Ar\B. 
Moreover, there exists a constant M > such that 

\\ak-c\\<M— and \\bk-c\\<M—. 
II ft II - ^p II ft II - ^p 

where p := ? t- and B(n — 1) is the central binomial coefficient with 

min|(2d-l)"-l,2/3(n-l)d"-2| 

respect to n — 1 which is given by (f(„"7)/2l)' 



4.1 The case of two sets v^^ith empty intersection 

When m = 2, we can consider the general case where the intersection of these two sets is 
(possibly) empty. 

We assume throughout this subsection that 



gi , hj are convex polynomials with degree at most d, \/i = 


= 1,2,-- 


■ ,m, j = 


= 1,2,-- 


• J 


A:= {x £W \ gi{x) < 0, i = 1, • • • , m} 










5:={xeM"|/ij(x)<0,i = l,--- ,/} 










bo G M", afc+i := P^fefc, bfc+i := PBak+i- 











We first need the following lemma. 
Lemma 4.4 The difference B — A of these two semi-algebraic sets A, B is closed. 

Proof. Let bk € B and Ok £ Ahe such that bk — fflfc — > c. We now show that c £ B — A. 
Consider the following convex polynomial optimization problem 

(P) min^giR",yeM" ll(y-a;)-c|p 

s.t. gi{x) <0,i = 1,--- ,"i, 

hj{y)<0,j = !,■■■ ,1 
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Note that {ak,bk) are feasible for (P). Hence we see that inf(P) = 0. By Fact 2.13, the 
optimal solution of (P) exists. Thus there exists x £ A and y & B such that c = y — x £ 
B — A. Hence the conclusion follows. D 



Remark 4.5 With A and B defined as above, Fact 2.13 implies that B — A \s closed 
convex. Hence Pb-a^ 7^ 0- Let v := Pb-a^- Then, there exist a G A and b £ B such 
that V = b — a and hence dist(yl, B) = \\v\\. (} 



Remark 4.6 In general, the distance between two convex and semi-algebraic sets need 
not be attained. For instance, consider D := {(xi,X2) G M^ | xi2;2 > l,3;i > 0,X2 > 0} 
and E := {(xi,X2) € M? \ xi = 0}. It is clear that D,E are convex sets while D is not 
a semi-algebraic convex set (as explained in Example 2.2). Clearly, dist{D,E) = but 
D n E = ^. Thus, the distance is not attained in this case. 



The proof of Theorem 4.7 partially follows that of [6l Theorem 3.12]. 



Theorem 4.7 (Convergence rate in the infeasible case) Assume d > 1. Then 
ak — > a £ A and bk — > b G B with b — a = v where v := Pb~aO- Moreover, there exists 
M > such that for every k £N 

1 



{d-k ~ Ci\\ < M 



1 

kP 



(4.13) 

where p := ? 7 

min|(2d-l)"-l,2/3(n-l)d"-2| 

respect to n — 1 which is given by (f(-„"ri)/2l)' 



and \\bk,-b\\<M — , V/c G N, 
kP 

and /3(n — 1) is the central binomial coefficient with 



Proof. Lemma 4.4 implies that A — B \s closed. Then by Fact 2.15|^i), there exist a G 



A,b €z B such that a^ — > a ^ A and bk 
exists Co > such that 



b E B with b — a = V. By Theorem 



3.6 



there 



(4.14) dist(aA;,^n {B - v)) < co(dist(afc,^) + dist{ak,B -v))'' = cq dist >■ (a/,. , S - v) 



(2d-l)"+l 



, /3(n - l)d"}. Fixx £ An{B -v). Note that v = Pb-aO we 



where r := min | 

have Pb {x) = j; -|- f by Fact 2.15[ ii) . This implies that 

dist (ofc, B — v) < 



< 



< 



Wk - {bk -v)\\ = \\{ak -x) - {bk - {v + x))\\ 

\{ak - x) - {Psak - Pbx)\\'^ 

\o.k — x\\ — llPeOfc — Pbx\\ (by [10, Proposition 4.8]) 

\ak -a;|p - ||6fe - {x + v)\\'^ 

\ak - xf - \\PAbk - Pa{x + v)\\^ 



dk - x\ 



\ak+i-xf (byFact[2j[5|:ii)) 
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In particular, choose x = PAr\{B-v)0'k- Then, we have 

(l\st^{ak,B -v) < d\st'^{ak,Ar\{B -v))-\\ak+i- PAn(B-v)ak\? 

< dist^(afc,yln {B -v)) - dist^(ayt+i, A n {B -v)). 



Combining with (4.14), we have 
1 



r,2r 



dist^'Xafc, An{B -v)) < dist^(aA:, (B - v)) 



(4.15) 
Thus 



< dist^(afc,An (B -v)) - dist^(afc+i,^ n {B -v)). 



dist(afc+i,An {B -v)f < dist(afc,yln [B - v))^ - ^^dist(afc,An {B -v)f''. 



Now, let (3k := dist(afc, An{B - v))'^, k £N. Then, we have 



A+i < Pk{l - -^Pk) 



Applying the preceding Lemma 



4.1 



with 6k '■= -2F find p := r — 1, we see that 



dist2(afc, ^ n{B-v)) = Pk<( Pi'' +^'' ^^■ 



r,2r 



1 
J--1 



for all k €N. 



Thence there exists Mq > such that 



dist{ak,An{B-v)) <Mo — , \fkeN 



where p :- 



in{(2d-l)"-l,2/3(n-l)d"-2} 

monotone with respect to An {B — v). Thus, by Fact 2.17[ 



. Then, |6i Example 3.2] shows that {ak)keN is Fejer 



|afc-5|| < 2dist{ak,An{B-v)f < 2Mo — , VA; G N. 



kP- 



Similarly, we can show that there exists Mi > such that 



dist(bk,Bn(A + v))<Mi— and \\bk - b\\ <2Mi — , VA; G N. 

kP kP 

Therefore, the conclusion follows by taking M := max{2Mo, 2Mi}. 



D 



5 Examples and remarks 

In this section, we will provide several examples of the rates of convergence of the cyclic 
projection algorithm and the von Neumann alternating projection algorithm. 
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Example 5.1 Let 



Ci 
C2 
C3 



{{x, y)£R^\{x + lf + y^-l< 0} 
{{x,y) gM^ I x + y- 1 < 0} 
{{x, y) G M^ I (x - 1)2 + y2 - 1 < 0} 
{{x,y) eR^\x + {y + 2f-4:<0}. 



Take xq G M^. Let {xk)keN be defined by 

xi := Pixo, X2 ■■= P2X1, X3 := P3X2, X4 := P4X3, X5 := P1X4 . . , 
Then ||xfc|| = O(^). 

fc5 







Proof. Clearly, nj=i ^i — {0}- Then apply n = 2 and d = 2 to Theorem 

Example 5.2 Let 

^ := {(x, y) G R2 I (x + 1)2 + y2 - 1 < O} 
5 := {(x, y) G M^ I (x - 2)2 + y2 _ 1 < 0}. 

Let (afc)fceN, (^fc)fceN be defined by 

60 G M , Ofc+i := PAbk, &fc+i := PBO-k+i- 
Then llafcll = 0(4), ll^fc - (1,0)|| = 0{\). 

fcB fcB 



4.2 



D 







Proof. By the assumption, there exist unique points oq G bd^, 60 G bdi? such that 
1 = dist(A, i?) = ||ao — feoll- Clearly, oq = (0,0) and 60 = (1)0). Then, the conclusion 
follows by applying Theorem 4.7 with n = 2 and d = 2. D 



Example 5.3 Let a > and 



A:={{x,y) gM2 I (x + l)2 + y2_i<o} = (-1,0) +B(0, 1) 



B:= {(x,y) G 



+ Q < 0}. 



Let (afc)fceN := {uk,Vk)km and {hk)km ■= {sk,tk)ken be defined by 



60 G M , Ofc+i := PAbk, bk+i := Psak+i- 



Then for every k > 2 
bk = (a, 



flfc+i 



(l + a)2(fc-i)+t2^f-^2((l + „)2i 
a + 1 



1 + 



h 



(« + l)2 + 7T 



(i+")^('=-^)+t?Eto ((!+")' 



\2k _i_ +2 v^fc-1 



(i+ar^+tizuii^+o^: 



i2i' 
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Consequently, a^ — > and bk — > {a, 0) at the rate of A: 2 when a = 0. When a ^ 0(then 
AnB = 0), ak — > and bk — > (a, 0) at the rate of (1 + a)~''. 



Proof. We first claim that 

(5.1) bk+i = {a,tk+i) = ( 



a, 



tk 



a+o^r+ti 



), yk>i. 



By [TOl Examples 3.17&;3.21 and Proposition 3.17], we have 
(5.2) 



P^(x,y) = (-1,0) + /,'',^^'^1 ,„, , V(x,y)GM2 



max{l,||(x+l,2/)||} 
PB{x,y) = {a,y), \/{x,y) ^ intB. 



Let A; > 1. Since An B = {0} ot An B = 0, Uk ^ int B. Then by ([5^, bk = (a, Vk) and 
then 



Ofc+i = PAbk = (-1,0) + 



'1 + a,Vk) 



max 



bk+i = Psiak+i) = (a, 



{l,||(l + a,^fc)||} 

Vfc X / tk 



(-1,0) + 



'1 + a,'Ufc) 



(l + a)2 + T;2 



1 + 0)2+^2 



(a. 



(l + «)^ + il' 



Hence (5.1) holds. Next we show that 
(5.3) 



bk= [a 



h 



(l + a)2(fc-i)+t2^*;r2((l + a)2* 



, VA; > 2. 



We prove (5.3) by the induction on k. 



By (5.1), (5.3) holds when k = 2. Now assume that (5.3) holds when k = p, where 
> 2 

(5.4) 



p >2. Now we consider the case of fc = p + 1. By the assumption, we have 



bp= \a. 



(l + a)2(p-l)+t2^P-2((l + a)2« 



Then by (5.1), we have 



bp+i = ( a 



(l + a)2 + t2 



h 



a, 



a, 



(l + a)^(^-^)+i?E£o((l + «)'^ 



'(l + a)2 + 



(l + a)2(p-l)+t2^P-2(l + a)2« 

tl 



(l + a)2p + i2^f-„i((l + a)2^ 
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Hence (5.3) holds. 



Combining (5.2) and (5.3), we have for every k>2 



-1 + 



a + 1 



h 



(a + 1)2 + 



(l+a)2('=-i)+t2j]^J^f((l+Q)2» 



\2k I +2 v^fe-1 



(l + aP + tfEr=o((l + «) 



2i 



Hence a^ — )■ and bk — > (a, 0) at the rate of k 2 when a = 0. When a ^ 0, ak — > 
and bk — > (a,0) at the rate of (1 + a)~'^. D 



Remark 5.4 According to Theorem 4.7 we can only deduce that (ak)k£N in Example 5.3 
converges to (0,0) and {bk)keN converge to (a,0) at the rate of at least of fc~6. 



Example 5.5 Let 



A := {{x, y)£R'^ \{x + lf+y^ -1< O} 
B ■= {{x, y) G M^ I (x - 1)^ + y2 - 1 < 0}. 



Let {xk,yk)keN be defined by 
{xo,yo) e IK^,(a;i,yi) := PA{xo,yo),{x2,y2) := PB{xi,yi),{x3,y3) := PA{x2,y2) 



Note that 



PA{x,y)= (-1 + 
PB{x^y)= (1 + 



x-l 



V(x + l)2+y2'^(^+l)2 + y2 

X + 1 y \ 



J, V(x,y)GM+xR++ 
, V(x,y) gM_ xM++. 



^ V(2;-l)2+y2'^(x-l)2+y2^ 

Figure [I] depicts the algorithm's trajectory with starting point (0,2). 

Suppose, without loss of generality, that one starts on a point on one the half-circles 



nearest the other circle. Then the distance from zero (for every A; G N), r^ := \ x'j, + y| 
satisfies rf, = 2ak where a^ := \xk\ since {xk,yk) S bdylUbdi?. Hence 

, l + a/c 

Linearizing, we obtain that tf^ := 4afc approximately satisfies the logistics equation 

Wk+l ~ w^fc(l -Wk) 
This can be explicitly solved by writing 



1 



1 



1 



Wk+l Wk l-Wk 
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Figure 1: The iteration commencing at (0,2). 



When summing and dividing by N, leads to 

1 



(5.5) 



hm 



hm 



N^oo Nwn' N^oo \Nwi\l Nwq 

N-l 



1 



1 



hm — > 

Af-s>oo N ^^^ I - 



hm 



k=0 
1 



Wk 



1, 



Af-s>oo 1 — Wn 

since Cesaro summabihty is conservative and wn — t- 0. Hence ak ~ 1/(4A;) and so 

4 + yl = n^ 



2k 
For instance, with oq = l,iV = 10^, we obtain on » 0.0000002499992442. A similar 



analysis can be performed in the previous example. 







Remark 5.6 According to Theorem 4.7 we can only deduce that {ak)k&-M and {bk)k&N in 
Example 5.5 converge to (0,0) at the rate of at least of /c~b. (} 



Example 5.7 Let A, B be defined by 

A:= {{x,y) gM^ I x< 0} 

B ■= {{x,y) gM^ I y2-x<0}. 

Let (afc)fcgN, ibk)keN ■= ixk,yk)keN be defined by 

bo := (xo, yo) G IK X ^+ with ||6o|| < 1, o^+i := ^A^fc, &fc+i := -PbO/c+i- 
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Then for every k £N 

Ofc+i = (0,yfc), h = iyl,yk): and 2/fc+i ^ Vk - 2yl. 
In consequence, {ak)keN and {bk)keN converge to at the rate of at least of k~ 



Proof. Let A; G N. Since ACiB = {0},bk ^ iniA. Since bk GhdB and then Xk = yl- Thus 
afc+i = -Pyi^fc = PAixk,yk) = {0,yk). Then we have 

bk+i = {xk+i,yk+i) = {yl+i,yk+i) = Psak+i = PB{0,yk)- 
Thus {y1,i,yk+i) is a minimizer of the function 

y^Uy\y)-{0,yk)f = 
Thus 



\y-yk)f = y^ + y^-2yyk + yl 



4y^+i + 2yfc+i - 2yk = 0. 



Then we have 



Vk+i = i ( 54yfc + 6^6 + 81y2 j ^ _ ( 54y,, + 6W6 + 81y^ 



Linearizing the above equation, we have 

(5.6) yk+i^yk-'iyk = yk{l-'^yk)- 



By (5.6), we have 



yl+i - ivk - '^ylf -yl- ^yt = vli^ - ^vD- 

Set ujk '■= Vk- Then we have 



Similar to the corresponding lines in Example 5.5, we have y^ — > at the rate of exactly 
k^2. Thence {ak)k<^N and {bk)keN converge to at that rate. D 



Remark 5.8 Simi larly , according to Theorem 4.7 we can only deduce that {ak)keN and 
(&fc)fceN in Example 5. 7| converge to (0, 0) at the rate of at least of A;~6 . Using the technique 
in the proof of Example |5.7[ we can show the sequence of the alternating projections in 
Example 5.3 converges to at the rate of k~2 when a = 0. 
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6 Conclusion and Open Questions 

In this paper, we studied the rate of convergence of the cycHc projection algorithm appHed 
to finitely many semi-algebraic convex sets. We established an explicit convergence rate 
estimate which relies on the maximum degree of the polynomials that generate the semi- 
algebraic convex sets and the dimension of the underlying space. We also examined some 
concrete examples and compared the actual convergence rate with our estimate. 

Our results have suggested the following future research topics and open questions: 



• The explicit examples (Example 5.3, 5.5 and 5.7) show that, in general, our estimate 
of the convergence rate of the cyclic projection algorithm will not be tight. It would 
be interesting to see how one can sharpen the estimate obtained in this paper and 
get a tight estimate for the cyclic projection algorithm. In particular, finding the 
right exponent when each set is defined by convex quadratic functions would be a 
good starting point. 

• Can we extend the approach here to analyze the convergence rate of the Douglas- 
Rachford algorithm? 

These will be our future research topics and will be examined later on. 
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